AD-A257  279  TATION  PAGE 


Form  Approved 
0MB  No.  0704-0188 


^  to  1  Hour  oer  mciu4in9  the  ttme  for  reviewing  mstruaioot.  se«rchin9  e«'ttin9  dat}'f0uf^. 

iewin9  the  cotleaioo  of  informjt<on  Ser>d  comments  reoarding  tht$  burden  estimate  or  any  other  aspect  of  this 
dert  to  Washtngtort  Headquarters  Services.  Directorate  for  information  Operations  and  Reports.  12 15  Jefferson 
'ice  of  Management  and  Budqet.  Paperwork  Reduction  Projea  (0704-0 1B8).  Washington.  DC  20S03 


1.  AGENCY  USE  ONLY  (Leave  blank)  2.  REPORT  DATE 

September  1992 

4.  TITLE  AND  SUBTITLE 

Stationary  Time  Series  Analysis  Using 
Information  and  Spectral  Analysis 

6.  AUTHOR(S) 

Emanuel  Parzen 


I  3.  REPORT  TYPE  AND  DATES  COVERED 


I  S.  FUNDING  NUMBERS 


DAAL03-90-G-0069 


I  7.  PERFORMING  ORGANIZATION  NAME(S)  AND  AOORESS(ES) 


^  775'^^  3/V3 


B.  PERFlaiiriN»0R4Alllr 
jlltelWIlUliqER'*; 


9.  SPONSORING /MONITORING  AGENCY  NAME(S)  AND  AODRESS(ES) 

U.  S.  Army  Research  Office 
P.  0.  Box  12211 

Research  Triangle  Park,  NC  27709-2211 


CT2T1992 


10.  SPONSORING  /  MONITORING 
AGENCY  REPORT  NUMBER 


^^0  2  ?y')V. //-/«/<) 


11.  SUPPLEMENTARY  NOTES 

The  view,  opinions  and/or  findings  contained  In  this  report  are  those  of  the 
author(s)  and  should  not  be  construed  as  an  official  Department  of  the  Army 
osltlon.  policy,  or  decision,  unless  so  designated  by  other  documentation. 


12a.  DISTRIBUTION /AVAILABILITY  STATEMENT 

12b.  DISTRIBUTION  CODE 

Approved  for  public  release;  distribution  unlimited. 

*9*  |rviaA/r7iu/rr  ^V/v  Mrurv/a.J 

The  technical  aims  of  this  paper  are:  to  discuss  some  roles  of  information  ideas  and 
spectral  analysis  in  time  series  analysis  (sections  1  and  2);  extend  spectral 
estimation  by  exponential  models  and  extend  (to  time  series)  goodness  of  fit  tests  by 
components  (sections  3  and  4).  Section  0  presents  some  philosophy.  The  practice  of 
statistics  and  time  series  analysis  can "stand  on  the  shoulders  of  giants"  if  we 
develop  a  framework  which  unifies  diverse  methods.  Information  ideas  are  central  to 
a  unified  framework  since  they  clarify  and  extend  methods  by  providing  many  levels  of 
relationship  between  time  series  analysis,  classical  statistical  methods  for 
independent  samples,  and  signal  processing  problems  called  inverse  problems  with 
positivity  constraints. 


14.  SUBJECT  TERMS 

Entropy;  Renyi  information;  Stationary  time  series; 

IS.  NUMBER  OF  PAGES 

15 

Spectral  exponential  models;  Spectral  components 

16.  PRICE  CODE 

17.  SECURITY  CLASSIFICATION 

18.  SECURITY  CLASSIFICATION 

19.  SECURITY  CLASSIFICATION 

20.  LIMITATION  OF  ABSTRACT 

OF  REPORT 

OF  THIS  PAGE 

OF  ABSTRACT 

unclassified 

UNCLASSIFIED 

UNCLASSIFIED 

UL 

NSN  7540-01 -280-5500 


Standard  Form  298  (Rev  2-89) 
bv  STd  /39  ’8 


STATIONARY  TIME  SERIES  ANALYSIS 
USING  INFORMATION  AND  SPECTRAL  ANALYSIS 


Technical  Report  #187 
September  1992 


Emanuel  Parzen 


Texas  A&M  Research  Foimdation 
Project  No.  6547 

Sponsored  by  the  U.  S.  Army  Research  Office 
Professor  Emanuel  Parzen,  Principal  Investigator 
Approved  for  public  release;  distribution  unlimited 


i 


STATIONARY  TIME  SERIES  ANALYSIS 
USING  INFORMATION  AND  SPECTRAL  ANALYSIS 

EMANUEL  PARZEN 

Department  of  Statistics,  Texas  A&M  University 
Dedicated  to  Maurice  Priestley  on  his  60th  Birthday 

0.  Introduction  to  philosophical  and  technical  aims  and  means 

The  technical  aims  of  this  paper  are:  to  discuss  some  roles  of  information  ideas  and 
spectral  analysis  in  time  series  analysis  (sections  1  and  2);  extend  spectral  estimation 
by  exponential  models  and  extend  (to  time  series)  goodness  of  fit  tests  by  components 
(sections  3  and  4).  Section  0  presents  some  philosophy. 

We  believe  that  a  major  problem  of  statistical  theory  is  how  to  develop  technology 
transfer  firom  esoteric  methods  to  exoteric  methods.  We  define  exoteric  statistical  methods 
as  those  that  have  reached  the  status  of  a  consumer  product,  where  the  consmners  are 
applied  researchers.  Esoteric  methods  are  known  mainly  to  experts  who  are  researching 
the  theory  and  are  often  alleged  to  be  an  intellectual  game.  More  methods  need  to  reach 
the  status  of  consiuner  products  (applicable  methods)  because  computing  power  enables  us 
to  apply  several  methods  to  a  real  problem  and  reduces  the  personal  investment  required 
to  learn  how  to  apply  a  new  method.  It  should  now  be  possible  to  implement  the  growing 
consensus  that  problem  solving  by  comparison  of  several  methods  leads  to  conclusions 
which  have  increased  confidence. 

The  practice  of  statistics  and  time  series  analysis  can  “stand  on  the  shoulders  of  giants” 
if  we  develop  a  framework  which  tmifies  diverse  methods.  Information  ideas  are  central 
to  a  unified  framework  since  they  clarify  and  extend  methods  by  providing  many  levels 
of  relationship  between  time  series  analysis,  classical  statistical  methods  for  independent 
samples,  and  signal  processing  problems  called  inverse  problems  with  positivity  constrsdnts. 

Research  supported  by  U.  S.  Army  Research  OflBce 
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We  believe  that  statisticians  who  work  in  time  series  analysis  may  find  that  their  audi¬ 
ence  is  not  their  fellow  statisticians.  While  their  work  is  appreciated  by  many  researchers 
in  the  many  fields  in  which  time  series  analysis  is  applied  and  developed,  they  may  feel 
not  valued  by  the  majority  of  statisticians  (to  whom  the  extensive  literature  of  time  series 
analysis  seems  to  be  disjoint  from  the  main  stream  of  statistical  methods).  My  experience 
is  that  statisticians  should  imderstand  that  time  series  methods  provide  many  of  the  right 
foundations  for  the  successful  unification  of  statistical  methods.  I  feel  fortunate  to  have 
studied  time  series  analysis  intensively  before  beginning  (in  1977)  my  current  work  on 
non-parametric  data  modeUng,  unification  of  statistical  methods,  and  change  analysis. 

Another  benefit  that  I  have  derived  from  working  in  time  series  analysis  has  been  the 
friendship  of  Maurice  Priestley  and  his  wife  Nancy  since  we  first  met  in  1958.  As  I  express 
my  esteem  for  Maiuice  Priestley  and  honor  his  60th  birthday,  let  me  commend  Priestley 
(1981)  as  the  best  book  to  read  to  learn  about  time  series  analysis  in  both  the  time  and 
frequency  domains. 

1.  Entropy,  Cross-Entropy,  Renyi  Information 

The  pioneer  work  of  KiiUback  (1959)  made  statisticians  aware  of  the  fundamental  role 
in  statistical  theory  played  by  the  (KuUback-Liebler)  information  divergence  between  two 
probability  distributions  F  and  G]  we  define  it  by  a  definition  which  differs  from  usual 
definitions  by  a  factor  of  2: 

/(F;G)  =  (-2)  r  \og{g{x)/fix)}fix)dx 
J—oo 

when  F  and  G  are  continuous  with  probability  density  functions  f{x)  and  ^(x); 

/(F;  G)  =  (-2)'^log{pc(x)/pFix)]pF(x) 

when  F  and  G  are  discrete,  with  probability  mass  functions  PfC^:)  and  Pg{x).  One  reason 
for  the  importance  of  information  divergence  (among  other  possible  definitions)  is  that  it 
possesses  a  decomposition 


I(F;G)  =  H(F-,G)-H(F), 

2 


in  tenns  of  entropy  H{F)  and  cross-entropy  we  define 


0 


JJ(F)  =  (-2)  r  {log/(i)}/(x)<Ji, 

J—oo 

H(F;G)  =  (-2)  /“  {logs(x)}/(i)<ir. 

J—OO 

The  fundamental  work  of  Renyi  (1961)  deserves  more  attention  by  statisticians;  we 
define  Renyi  information  of  index  A  as  follows  for  continuous  F  and  G: 

{{mV  *}) 

for  A  /  0,  —1; 

FF„(F,G)  =  2/{M,„,M_M  +  , 

/2J..(F,G)  =  -2/{logM-M  +  l}/(,M, 

An  analogous  definition  holds  for  discrete  F  and  G. 

When  we  think  of  these  formulas  as  relating  non-negative  functions  /  and  g,  we  denote 
it  by  IRx(f]g).  This  definition  provides:  (1)  extensions  to  non-negative  functions  which 
are  not  densities,  and  also  (2)  a  non-negative  integrand  which  can  provide  diagnostic 
measures  at  each  value  of  y.  The  above  definitions  hold  also  for  multivariate  F  ^uld  G. 

2.  Asymptotic  Information  of  Stationary  Normal  Time  Series 

This  section  discusses  the  elegance  of  formiilas  provided  by  a  tmification  of  informa¬ 
tion  measures  of  stationary  normal  time  series  and  information  measures  of  non-negative 
functions  which  are  spectral  density  functions. 

When  a  time  series  t  =  1, 2, . . .}  is  modeled  by  alternative  probability  measures 

Pi  and  P2  for  the  infinite  sequence,  we  define  asymptotic  information  divergence  (or  rate 
of  information  divergence) 

AsymIRA(F!!|Fi)  = 

n— *00 

where  is  the  multivariate  distribution  under  Pi  of  y(i),  <  =  1, . . . ,  n. 
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Let  y(.)  be  zero  mean  stationary  with  covariance  function 


fl(v)  =  £(r(()K((  -  v)]. 

and  correlation  function 

p(,v)  =  iHvym- 

Parzen  ((1981),  (1983))  shows  how  empirical  modeling  of  a  time  series  from  data  can  be 
approached  by  using  concepts  of  information  to  measure  the  predictability  of  Y{i)  from 
past  values  Y{t  —  .  ^Y{t  —  m).  We  define  the  information  about  Y{t)  in  its  infinite 

past  Y{t  —  1),  ^^^(t  —  2), . . and  in  its  finite  past  by 

ioo  =  /(K|K_i,y-2, . . .)  =  -I  {fY\Y.,.Y- . •fy)  = 

im  =  /(y|y_i, . . . ,  Y-m)  = 

where  /y|Y  j,.  .,y  denotes  the  conditional  probability  density  of  Y{t)  given  Y{t  — 
l),...,Y{t~m). 

An  important  classification  of  time  series  is  by  memory  type:  no  memory, 

short  memory,  long  memory  according  as  /o©  =  0,  0  <  /(»  <  oo,  Joo  =  c».  Memory 

type  is  related  to  the  dynamic  range  of  the  spectral  density  function  of  the  time  series. 

The  spectral  density  function  /(w),  0  <  u;  <  1,  is  defined  as  the  Fourier  tramsform  of 

the  correlation  function  (asstuning  it  exists): 

oo 

f(.^)=  exp(-2fftW)p(u) 

t;=— OO 

We  call  a  time  series  bounded  memory  if  the  spectral  density  is  bounded  above  and  below: 

0  <  Cl  <  /(w)  <  C2  <  oo. 

Long  memory  occurs  when  there  are  zeroes  or  infinities  in  f{u>).  Bounded  memory  is 
intmtively  the  same  as  short  memory  or  finite  memory. 

Let  Pf  denote  the  probability  measure  on  the  space  of  infinite  sequences  Roo  cor¬ 
responding  to  a  normal  zero  mean  stationary  time  series  with  spectral  density  function 
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An  important  result  of  Pinsker  [(1964),  p.  196]  can  be  interpreted  as  providing  a  for¬ 
mula  for  asymptotic  information  divergence  between  two  zero  mean  stationziry  time  series 
with  respective  rational  spectral  density  functions  /(u;)  and  g(u}).  Write  AsymIR_x(/,^) 
for  AsymlRxiPf;  Pg).  Adapting  Pinsker  (1964)  one  can  prove  that 

AsymIR_i(/,5)  =  f  {(/(w)/<7(w))  -  1  -  \og{f{u)/g(u))}  dw 

Jo 

The  right  hand  side  is  called  by  electrical  engineers  the  Itakura-Saito  formula  and  plays 
an  important  role  in  signal  processing. 

Because  spectral  densities  are  even  fvmctions  we  can  take  the  integral  to  be  over 
0  <  u;  <  .5;  then  one  obtains  the  following  important  theorem. 

Theorem:  Unification  of  information  measures  of  Pinsker  (1964)  and  Itakura-Saito 
(1970). 

AsymIR_i(/,i7)  =  IR-i(f{ui)/g((^))o,.b 

The  validity  of  this  identity  of  information  measures  can  be  extended  to  non-normal  asymp¬ 
totically  stationary  time  series  (Ephraim,  Lev-Ari,  Gray  (1988)).  It  can  be  called  Pinsker’s 
information  theoretic  justification  of  the  Itakiura-Smto  distortion  measure.  StatisticiEins 
might  try  to  imderstand  these  formulas  as  extensions  of  the  formula  for  the  information 
divergence  between  two  univariate  normal  distributions  with  zero  meems  and  different 
variances. 

For  bounded  memory  time  series  (and  — 1  <  A  <  0),  Kazakos  and  Kazakos  (1980) 
prove 

AsymIRA(/,^)  =  {log(/(w)/?M)  -  (1/(1  +  ^))log{l  +  (1  -f  A) 

((/(‘^)/5(‘*^))  - 

Kazakos  and  Kstzakos  (1980)  also  give  formulas  for  asymptotic  information  of  multiple 
stationary  time  series.  They  illustrate  how  formulas  for  —1  <  A  <  0  can  lead  to  formulas 
for  A  =  0  and  A  =  1. 
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3.  Estimation  of  Finite  Parameter  Spectral  Densities 

This  section  formulates  in  terms  of  otir  Renyi  information  notation  the  classic  asymp¬ 
totic  maximum  likelihood  Whittle  theory  of  time  series  parameter  estimation. 

For  a  random  sample  of  a  random  variable  with  unknown  probability  density  /,  max¬ 
imum  likelihood  estimators  d"  of  the  parameters  of  a  finite  parameter  model  fg  of  the 
probability  density  /  can  be  shown  to  be  equivalent  to  minimizing 

IR-lirJe) 

where  /~  is  a  raw  estimator  of  /  (initially,  a  symbolic  sample  probability  density  formed 
firom  the  sample  distribution  function  F").  A  similar  result,  czJled  Whittle’s  estimator 
(Whittle  (1953)),  holds  for  estimation  of  spectral  densities  of  a  boimded  memory  zero 
mean  stationary  time  series  for  which  one  assumes  a  finite  parametric  model  fffiu;)  for  the 
true  unknown  spectral  density  /(w). 

A  raw  fuUy  nonparametric  estimator  of  f{u)  firom  a  time  series  sample  V’(t),  t  = 
1, . . . ,  n,  is  the  sample  spectral  density  (or  periodogram) 

=  I  53l^(<)exp(-27rt'a;t)l2  ^  \Y{t)f 

t=l  t=l 

Note  that  /"(w)  is  not  a  consistent  estimator  of  f  {<*>)]  nevertheless, 

E  [/'(‘*^)1  converges  to  /(u;). 


a  fact  which  can  be  taken  as  the  definition  of  the  spectral  density  /(u;). 

An  estimator  ST  which  is  asymptotically  equivalent  to  maximum  likelihood  estimator 
is  obtained  by  minimizing  AsymIR_i(/'';/^)  =  /R-l(/",/tf)o,.5  = 

/  {(/”(")//<?("))  -  1  -  log(/''(‘^)//o("))} 

Jo 


which  can  be  interpreted  as  choosing  0  to  make 


as  flat  or  constsmt  as  possible. 
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Whittle  pioneered  the  representation  of  a  parametric  model  for  a  Gaussian  stationary 
time  series  with  zero  mean  and  unit  variance 

fo{u)  = 

where  7^(u>)  is  the  square  modulus  of  the  transfer  function  of  the  whitening  filter  repre¬ 
sented  by  the  spectral  density  model  /(j,  and  is  defined  to  satisfy 

a 


f  \ogfg{u})dw  =  loga^  =  -Joo- 

Jo 


Note  that  0  <  <  1  and  is  the  ratio  of  the  conditional  variance  of  Y{-)  given  its 

infinite  past  and  the  unconditional  variance  of  Y{‘). 

Minizimizing  AsymIR_i(/”,/^)  is  equivalent  to  minimizing 

Ml 

which  is  equivalent  to  minimizing  over  6 

and  setting 

=  /  7^-fu;)/~(a;)(iu;  =  <r|- 
Jo 

The  information  divergence  between  the  data  and  the  fitted  model  is  given  by 

=  Iog.Tj.  -  Iog<r-2  =  /oo'-  /a,- 

defining  —  Joo*  =  logo  » 

i-1 

-Ioo~  =  log<T’2  =  /  log/"(u;)<iu; 

Jo 

This  criterion  (however,  corrected  for  bias  in  I<x>~)  arises  firom  information  approaches 
to  model  identification  (Parzen  (1983)).  A  model  fitting  criterion  (but  not  a  parameter 
estimation  criterion)  is  provided  by  the  information  increment 

I{Y\  all  past  Y\  Y  values  in  model  9) 

=  -  log  {r(u;)//tf-(a;)}  dw  =  /i2_i  (r//tf-)o.-.5 

Jo 
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One  can  regard  it  as  a  measure  of  the  distance  of  the  whitening  spectral  density 

r  (u;)  = 

from  a  constant  function;  note  that  /*((*})  is  constructed  to  integrate  to  1. 

Our  philosophy  of  identification  of  parametric  models  for  a  stationary  time  series  is  to 
choose  them  so  that  by  the  criteria  of  the  next  section  of  this  paper  an  optimal  smoother 
of  the  computed  function  is  a  constant;  then  a  “parameter-free”  non-parametric 

estimator  of  the  spectral  density  f(u)  by  a  smoother  of  /“(u;)  is  given  by  the  parametric 
estimator  fg-.  By  “parameter-free”  we  mean  that  we  are  free  to  choose  the  parameters 
to  make  the  data  (raw  estimator)  shape  up  to  a  smooth  estimator.  The  parameters  are 
not  regarded  as  having  any  significance  or  interpretation;  they  are  merely  coefficients  of  a 
representation  of  /(w). 

Portmanteau  statistics  to  test  goodness  of  fit  of  a  model  to  the  time  series  use  stuns 
of  sqtiares  of  correlations  of  residuals;  an  analogous  statistic  is 

iRi  (rtf »■)<,, j, = log  / 

JQ 

Goodness  of  fit  of  the  model  to  the  data  (as  measured  by  how  close  is  to  the  spectral 

density  of  white  noise)  is  the  ultimate  model  identification  criterion  to  decide  between 
competing  ptu'ametric  models. 

4.  Goodness  of  fit  by  components  and  exponential  models 

Our  philosophy  of  stationary  time  series  model  identification  argues  that  goodness  of 
fit  tests  of  a  model  should  test  for  whiteness 

/*(u;)  =  nuy/iiu;). 

In  this  section  we  propose  an  analogue  of  the  concept  of  components  introduced  in  the 
classical  goodness  of  fit  theory  by  Durbin  and  Knott  (1972): 

T*( J)  =  2" /  f*(u)J(u})duj 

Jo 


8 


for  variou.®  xore  fxinctions  J(u;),  which  one  evaluates  in  practice  as  a  sum  over  a  dense 
grid  of  frequencies. 

One  usually  forms  a  sequence  of  components  whose  score  functions 
Jq(u))  =  1,  /2(w), . . . 

are  a  complete  orthonormal  set  of  functions  in  £2(0*  !]•  Choices  are:  harmonics 
(coe2irju,j  =  0,1,2,...);  Legendre  polynomials;  Hermite  polynomial  functions  of  the 
standard  normal  quantile  function  Note  that  /q  Jj(w)dw  =  0  for  j  =  1,2,...  . 

Under  the  assumption  that  /(w)  =  /(a>;  0)  for  some  parameter  vector  0,  the  ausymptotic 
distribution  of  T*{Jj)  is  the  same  as  the  spectral  average  2~'^  Jq(1/ f(ij))Jj(iv)f~(uj)du}; 
the  latter  are  asymptotically  normal  with  mean 


and  variance 

(2/n)  j|‘(l/2/2(w))|Jy(u.)|V^u,)X)  =  (1/n)  jf'  =  1/n. 

Thus  properly  defined  components  are  asymptotically  independent  Normal(0,l/n). 

A  component  based  quadratic  test  of  the  goodness  of  fit  of  the  model,  with  an  asymj>- 
totic  chi-square  distribution,  is 

Si,™  =  f;  ir(7,)|2 

i=* 

These  component  tests  have  the  asymptotic  optimality  properties  of  score  tests  if  we 
model  the  true  spectral  density  /(w)  by  an  exponential  model  extending  Bloomfield  (1973). 

The  main  technical  contribution  of  this  paper  may  be  the  following  proposal:  esti¬ 
mate  /(u;)  by  assuming  an  exponential  model  of  order  m  using  score  functions 
j  =  1, . . . ,  m.  The  choice  of  score  functions  and  criteria  for  deternuning  from  the  data  an 
optimal  order  m*  require  further  research. 

Note  that  an  exponential  model  for  the  spectral  density  provides  smooth  estimators 
of  the  log  spectral  density  and  therefore  of  cepstral  correlations  (the  Fourier  coeflScients 
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of  the  log  spectrum)  and  coeOcients  of  the  AR(oo)  and  MA(oo)  representations  of  a  time 
series  required  for  prediction. 

An  exponential  model  of  order  m,  denoted  fs^mi  is  defined 


=  ^0  +  +  •  •  •  + 

The  coefficient  interpretation  6q  =  Jq  log  f(uj)dij  =  log  cr^  where  <t^  is  the 

infinite  memory  one  step  ahead  prediction  mean  square  error.  An  exponential  model  can 
be  expressed 

m 

fe,m  = 

i=l 

Maximum  likelihood  estimators  d*”*  =  (^i“, . . .  ,^m*)  of  =  (^i, . . . ,  Bm)  are  equivalent 
to  minimizing 


A 

v(«)=  / 

i=l 

and  then  estimating  <7^  by 

An  estimated  spectral  density  is  given  by 


H) 


m 


it  satisfies 


defining 


Mw)  =  V(r"')exp(J^B/Jj(u;); 

J=l 

/^'”(u;)du;  =  1, 

^0 


The  product  of  the  Fisher  score  function  (derivative  with  respect  to  Bj  of  the  opti¬ 
mization  criterion  V(B))  and  2”  ®  is  denoted  Uj{B)\  for  j  =  1, . . .  ,m 

Vi(»)  =  j 

A  goodness  of  fit  test  of  a  model  of  order  m  is  ^ven  by  a  score  test  of  an  order  m 
sub-model  against  an  order  M  “full”  model: 


Uj{6''^)  =  0,j  =  m  -I- 1,. .., M 
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An  overall  chi-square  test  uses  the  sum  of  squares  of  these  score  statistics.  To  compute 
the  parameter  estimators,  let 

An  approximate  Newton-Raphson  iterative  scheme  for  computing  can  be  shown,  following 
Bloomfield  (1973),  to  be 

0-m(n+l)  _ 

Note  that  the  vector  of  correction  terms  in  this  iteration  is  the  vector  of  score  tests. 
Exponential  models  for  the  spectral  density  use  the  same  score  statistics  for  iterative  eval¬ 
uation  of  estimators  as  are  used  for  component  tests  of  goodness  of  fit. 

An  initial  estimator  of  dj,  adapting  Bloomfield  (1973),  is 

=  {\/n)'^\ogf’{2irt/n)Jj{2wt/n) 
t=\ 

We  conclude  our  heuristic  discussion  by  emphasizing  that  the  approach  outlined  above 
to  goodness  of  fit  and  spectral  density  estimation  needs  further  research  about  the  problems 
of  choosing  score  functions  Jj(a;)  and  determining  an  optimal  order  m. 
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